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Background 


The  UCLA  Center  for  Technology  Assessment  of  the  Center  of  the  Study  of  Evaluation 
has  an  existing  contract  with  the  Defense  Advance  Research  Projects  Agency  to  study  human 
benchmarking  methodology  for  the  evaluation  of  artificial  intelligence  systems.  Systems  of 
interest  include  vision,  natural  language,  experts  systems  shells  and  expert  systems.  This  final 
report  documents  the  implementation  of  the  Natural  Language  Sourcebook  hardcopy  document 
to  a  user  friendly,  interactive  HyperCard  database  stack. 


- Description  of  the  Final  Report - 

The  two  primary  tasks  of  the  project  were:  1 -Specifying  system  components  and 
2-Designing  and  devetoping  the  Sourcebook  database.  The  tasks  of  the  project  are  described 
in  the  following  sections: 

•  Section  1 ,  “Specification  of  System  Components,”  provides  a  description  of  the  content 
in  the  Natural  Language  Sourcebook  which  is  included  in  the  electronic  version  of  the 
Sourcebook  database. 

•  Section  2,  “Design  and  Development  of  the  Sourcebook  Database  "describes  the  overall 
design  and  documentation  of  the  development  of  the  HyperCard  stack  for  the  Sourcebook 
database  and  the  accompanying  User's  Manual. 


- Project  Deliverables - 

In  the  Natural  Language  Sourcebook  HyperCard  Project  there  were  three  deliverables: 

•  Sourcebook  Database 

•  Sourcebook  Database  User’s  Manual 

•  Final  Report 

Portions  of  the  text  and  figures  from  the  User’s  Manual  have  been  included  in  this 
final  report  to  provide  precise  explanations. 


- Purpose  of  the  Sourcebook  Database - 

The  Sourcebook  Database  was  developed  to  assist  artificial  intelligence  researchers, 
cognitive  scientists  and  computational  linguists  in  accessing  the  vast  amount  of  information 
contained  in  the  Sourcebook  in  a  more  efficient  and  effective  manner  than  possible  using  the 
hardcopy  version. 


-  About  the  Natural  Languaga  Sourcebook - 

The  Natural  Language  Sourcebook  is  a  collection  of  examples  representing  a  range  of 
processing  problems  in  natural  language  understanding.  The  focus  of  the  Sourcebook  is  on 
processing  problems  involved  in  building  artificial  Intelligence  systems.  The  processing 
problems  emerged  from  a  literature  search  primarily  in  the  field  of  artificial  intelligence  but  also 
in  the  related  fields  of  computational  linguistics  and  cognitive  science. 

Each  entry  in  the  Sourcebook  represents  a  problem.  The  entries,  called  "exemplars," 
each  oonsists  of  1)  one  or  more  sentences,  a  fragment  of  dialogue,  or  a  piece  of  text  which 
illustrates  a  conceptual  issue,  2)  a  reference,  and  3)  a  discussion  of  the  problem  a  system  might 
have  in  understanding  the  example.  An  example  is  used  to  illustrate  each  problem,  but  it  is  the 
discussion  that  defines  the  type  of  problem  by  delineating  the  information-processing  issues 
involved. 

The  Sourcebook  is  organized  around  a  classification  scheme  which  reflects  an  artificial 
intelligence  perspective  of  the  problems  encountered  in  processing  natural  language.  Additional 
classification  schemes,  one  with  a  linguistic  orientation  and  one  with  a  cognitive-psychological 
orientation,  provide  the  basis  for  cross-referencing  the  processing  problems.  Linguistic  and 
cognitive-psychological  cross-referencing  of  the  exemplars  allows  the  user  to  explore  alternate 
relations  among  the  examples  represented  in  the  Sourcebook.  Each  exemplar  has  at  least  one 
Inguistic  cross-reference  and  one  cognitive-psychological  cross-reference. 

The  Natural  Language  Sourcebook  can  serve  as  part  of  an  evaluation  methodology  for 
artificial  intelligence  systems  in  that  it  provides  an  overview  of  natural  language  processing 
problems  against  which  such  systems  can  be  assessed.  The  processing  problems  delineated 
by  the  Sourcebook  classification  scheme  define  four  discourse  types  which  an  artificial  intelli¬ 
gence  system  should  ideally  be  able  to  handle.  Those  discourse  types,  the  four  majorcategories 
in  the  Sourcebook  classification  scheme,  are:  I.  Single-utterance  issues,  II.  Connected- 
utterance  issues.  III.  True-dialogue  issues,  and  IV.  Ill-formed  input 

Group  I  includes  input  which  the  system  can  understand  using  only  existing,  stored 
knowledge.  This  knowledge  might  be  knowledge  about  syntax,  semantic  constraints,  or  world 
knowledge,  but  it  specifically  excludes  knowing  the  results  of  processing  previous  input.  The 
typical  Group  I  problem  involves  parsing  an  input  in  isolation  from  other  inputs.  Most  of  the 
examples  in  this  group  are  single  sentences,  but  it  should  be  noted  that  a  "single-utterance”  may 
consist  of  more  than  one  sentence.  The  examples  in  Group  I  are  the  ones  most  commonly 
discussed  in  the  linguistics  and  artificial  intelligence  literature. 

In  Group  II  problems,  the  system  must  be  able  to  integrate  information  spread  over  a 
series  of  utterances  and  must  be  able  to  refer  back  to  earlier  utterances,  but  the  system  need  not 
have  any  model  of  the  user.  The  only  interaction  between  the  system  and  the  user  is  that  the  user 
makes  statements  or  requests,  and  the  system  processes  them. 

In  Group  III  problems,  the  system  must  know  not  only  about  the  sequence  of  utterances 
read  but  also  something  about  the  user’s  goals,  intents,  and  expectations.  Group  III  examples 
do  not  necessarily  involve  an  actual  two-way  dialogue  between  the  system  and  the  user,  but  they 


i 


a 


at  least  involve  building  or  accessing  a  model  of  the  user.  Group  III  problems  involve  an 
interchange  between  two  knowledgeable  entities.  Group  III  systems  are  needed  for  intelligent 
interfaces  to  expert  systems. 

Groups  I,  II,  and  III  form  an  important  block  because  they  cover  examples  of  normal 
language  use.  The  remaining  group,  Group  IV,  ill-formed  input,  covers  examples  which  do  not 
conform  to  normal  language  use  but  which  a  program  may  nevertheless  encounter. 

(The  discussion  above  was  taken  from  Chapter  1,  Introduction  to  the  Sourcebook,  in  the 
User’s  Manual.) 
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The  first  task  for  the  implementation  of  the  Natural  Language  Sourcebook  into  the 
HyperCard  environment  was  to  specify  the  essential  content  features  of  the  Natural  Language 
Sourcebook.  These  would  become  the  system  components  for  the  database  in  the  HyperCard 
environment.  Seven  components  were  identified:  Sourcebook  Introduction,  Exemplars,  Source- 
book  Classification  Scheme,  Linguistic  Classification  Scheme,  Cognitive-Psychological  Classi¬ 
fication  Scheme,  Complete  References  and  Appendix. 

- System  Components - 


•  Introduction  to  the  Sourcebook 

The  introduction  to  the  Natural  Language  Sourcebook  is  presented  in  the  initial  section  of  this 
report. 

•  Exemplars  (197) 

Each  of  the  197  exemplars  in  the  Natural  Language  Sourcebook  contains  the  following  six 
components  (see  Figure  1.1): 

°  Exemplar  Classification  TyBfl 

The  exemplars  are  categorized  into  four  ma]or  discourse  types--!.  Single 
utterance  issues,  II.  Connected-utterance  issues,  III.  True-dialogue  issues,  and 
IV.  Ill-formed  input— and  various  subtypes  in  the  Sourcebook  Classification 
Scheme. 

°  Exemplar  Identification  Number 

The  exemplar  identification  number  corresponds  to  the  placement  of  the 
exemplar  in  the  Sourcebook  Classification  Scheme. 

°  Problem  Section 

This  section  consists  of  one  or  more  sentences,  a  fragment  of  dialogue,  or  a 
piece  of  text  which  illustrates  a  conceptual  issue. 

•  Abbreviated  Reference 

The  abbreviated  reference  displays  the  author’s  name,  date  and  page  numbers 
of  the  reference  from  which  the  examples  in  the  problem  section  were  taken. 

•  Discussion  Section 

This  section  provides  a  discussion  of  the  problem  a  system  might  have  in 
understanding  the  example  given  in  the  Problem  Section. 


These  cross-references  for  each  exemplar  allow  the  user  to  explore  alternate 
relations  among  the  examples  represented  in  the  Natural  Language  Sourcebook. 


ti 


■  FIGURE  1.1 
Typical  Examplar 

Exemplar  clatalfl cation - 

Examplar  Id  antiflea tl on  number 


Problem  section . 


Abbreviated  reference . 


Discussion  section 
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Cognitive-psychological 
classification  entries _ 


SINGLE-UTTERANCE  ISSUES 


Jdentification  of  Syntactic  Units 
Exemplar  I.A.  (#2) 


Problem 


(1) ...mental  building  block 

(2) ...large  Chinese  restaurant 

(3) ...meat  shop  owner 

(4) ...feariess  Chinese  soldier 

(5) ...heavy  cigar  smoker 

(6) . ..Indian  Ocean  cruise  line 

(7) ...glant  shrimp  cocktails 

(Gershman,  1982,  pp.  182-185) 


Discussion 

In  the  noun  groups  above,  there  are  some  compli¬ 
cations  in  attaching  noun-modifiers  to  nouns.  In  “heavy 
cigarsmoker,"“heavy"  modifies  “cigarsmoker  not  “dgar.“ 
In  “Indian  Ocean  cruise  line,”  however,  “Indian*  modifies 
“Ocean*  and  not  “Ocean  cruise  line.” 

The  following  principles  help  the  parserdetermine 
the  attachment  of  modifiers  to  nouns: 

1)  Only  concepts  built  by  adjacent  words 
can  modify  each  other:*mental  block”  is  not 
the  same  as  “mental  building  block.” 


Linguistic:  I A1.  Noun/Verb 

I.A.2.  Noun/adjective 
I.A.3.  Noun/participial  adjective 
I.C.1.  Noun  phrase  structure 

Cognitlve-psychologicat.  I.A.  Processing  syntax 


•  Sourcebook  Classification  Scheme 


Figure  1 .2dispiaysthe  Sourcebook  classification  scheme  aroundwhichthe  Natural  Language 
Sourcebook  is  organized. 


■  FIGURE  1.2 
Sourotbook 
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Sourcebook  Classification 

I.  Single-utterance  issues 

A.  Identification  of  syntactic  units 
BAmbiguity 

1.  Lexical 

2.  Attachment 

C.  Modifier  attachment 

1.  Prepositional  phrase 

2.  Other 

D.  Reference 

1.  Anaphoric 

2.  Non-anaphoric 

3.  Distinguishing  anaphoric  from  non-anaphoric 
reference 

4.  Temporal 

E.  Metaphor  and  novel  language 

F.  Other 


II.  Connected-utterance  issues 

A.  Anaphora 

B.  Ellipsis 

C.  Integrating  complex  information 

D.  Reasoning,  argumentation,  story  understanding 

1.  Irony 

2.  Plans  and  goals 

3.  Belief  modification 

4.  Argumentation 

5.  Summarizing 

E.  Metaphor 


III.  True-dialogue  issues 

A.  User  goals  and  plans 

B.  Logical  presuppositions 

C.  Speech  acts 

D.  Meta-linguistic  discourse 

IV.  Ill-formed  input 

A.  Mistakes 

1. Mistypings 

2.  Syntactic  constraint  violations 

3.  Semantic  constraint  violations 

B.  Non-standard  input 

1.  Incomplete  sentence 

2.  Casual  structure 

3.  Idiolect 
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•  Linguistic  Classification  Schema 


Figure  1.3  displays  the  first  of  two  pages  used  for  the  linguistic  classification  scheme. 


■  FIGURE  U 
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Linguistic  Classification 
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I.  Syntactic  units 

A.  Grammatical  category 

1.  Noun/verb 

2.  Noun/adjective 

3.  Noun/participial  adjective 

4.  Verb/participial  adjective 

5.  Verb/auxiliary 

6.  Verb/preposition 

7.  Preposition/particle 

8.  Pronoun/possessive  pronoun 

9.  Demonstrative/complementizer 

B.  Wordsense 

1.  Lexical  Items 

a.  Noun 

b.  Verb 

2.  Idiomatic  phrases 

C.  Constituent  structure 

1.  Noun  phrase  structure 

2.  Prepositional  phrase  attachment 

3.  Participial  modifier  attachment 

4.  Phrasal  veib  structure  (verb-preposition, 
verb-particle) 

5.  Passive 

6.  Coordination 

7.  ApposKIve 

8.  Vocative 

9.  Complex  sentence  structure 

10.  Syntactic  ambiguity 

11.  ‘Garden  path”  sentences 

II.  Discourse  structures 

A.  Functional  sentence  perspective 

B.  Discourse  relation  of  clause 

C.  Discourse  segment  function 


III.  Semantic  interpretation 


•  Cognitive-Psychological  Classification  Scheme 


Figure  1 .4  displays  the  first  of  1 1  pages  used  for  the  cognitive-psychological  classification 
scheme. 


■  FIGURE  14 

CognlUv*-P«ycho  logical 
Ctaulflcatlon  Scheme 
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Cognitive-psychological  Classification 


I.  Processing  single  utterances 
A.  Processing  syntax 

1.  Type  of  sentences 

a.  Declarative 

1. )  Active 

2. )  Passive 

b.  Interrogative 

c.  Imperative 

2.  Types  of  phrases  and  clauses 

a.  Nouns  vs.  modifiers 

b.  Noun  groups 

c.  Prepositions  in  noun  groups 

d.  Appositrves 

e.  Other  modifiers 

3.  Word  order 

a.  Standard 

b.  Inverted 

4.  Referents 

a.  Structure-based 

1. )  Of  adjectives 

a. )  Post  nominal 

(1.)  Participai  phrases 
(2.)  Relative  clauses 

b. )  Standard 

2. )  Of  pronouns 
a.)  Direct 


•  Complete  References  of  citations  In  the  exemplars 


Figure  1 .5  displays  part  of  the  first  of  9  pages  used  for  the  complete  references  of  authors 
cited  in  the  Natural  Language  Sourcebook. 


■  FIGURE  1.5 

ItefWMOM 
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•  Appendix 

The  appendix  provides  discussions  about  the  development  of  the  linguistic  and  cognitive- 
psychological  classification  schemes. 
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The  purpose  of  the  second  task  was  to  provide  the  overall  design  and  documentation  of 
the  development  of  the  HyperCard  stack  for  the  Sourcebook  Database  and  the  accompanying 
User’s  Manual. 


_ Sourcebook  Database  Specifications _ 

The  Sourcebook  Database  is  a  HyperCard  stack  which  contains  the  information  found 
In  the  Natural  Language  Sourcebook.  The  Sourcebook  Database  stack  works  with  any  Apple 
Macintosh  computer  with  HyperCard  1 .2  or  higher,  one  megabyte  of  memory  or  more  and  at  least 
one  800K  disk  drive.  The  Sourcebook  Database  stack  contains  335  cards,  which  have  been 
classified  into  the  following  categories: 

no.  of 

Description  cards 


Title 

Introductory 

Exemplars 

Classification  Schemes 
Complete  References 
Quick  Reference 
Exit 


Sourcebook  Database  Design 


The  Sourcebook  Database  was  designed  into  three  modules:  1)  Integrating  system 
components,  2)  Complementing  the  system  components  with  browsing  and  searching  features, 
and  3)  Incorporating  on-fine  assistance  features  to  accomplish  user-friendliness. 

•  Title  card 

The  opening  card  welcomes  the  user  to  the  Sourcebook  Database  and  asks  the  user  V  an 
introduction  to  the  database  is  requested  (see  Figure  2.1) 

■  FIGURE  2.1 
Till*  Scrawl 


WELCOME  TO  THE 

SOURCEBOOK 

DATABASEI 

Os  ymi  nrad  m  tnlrsductlra  li  in# 
(Using  ths  moust,  dick  i 


•  Introductory  cards 


The  introductory  cards  contain  information  about  the  project,  Natural  Language  Sourcebook, 
Prompting  mode  and  Quick  Reference  Guide  (see  Figure  2.2). 


■  FIGURE  24 
About  tho  Quick 
Rafaranoo  Guido 


j  ABOUT  THE  QUICK  REFERENCE 


A  quick  reference  guide  ec peers 
when  you  click  on  the  ffl  etthe 
top  right  of  the  ecreen  while 
viewing  en  exempier.  TIM  quick 
reference  guide  prsvtdee  an 
•xplenetlon  of  the  verioue  but  tone 
thet  ere  on  eech  exemplar  eerean. 

From  here,  you  will  eulomeltcetly 
go  to  the  guide  when  you  click  on 
'CONTINUE*  at  the  bottom  tight  of 
the  ecreen. 


Integrating  System  Components 


•  Exemplars 


Each  of  the  197  exemplars  is  displayed  on  one  card  in  the  format  of  an  open  book  (see 
Figure  2.3).  The  left  page  of  each  exemplar  contains  the  exemplar  identification  number,  type 
of  exemplar  classification,  problem  section  section,  and  abbreviated  reference.  The  right 
page  contains  the  discussion  section  only.  The  problem  and  discussion  sections  are 
presented  in  scrolling  fields  when  they  are  longer  than  one  screen. 


FIGURE  24 
Typical  Exemplar 
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Exemplar  classification 

^Exemplar  Identification  number 


Problem  section . 
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Abbreviated  reference 


(ampler  I.A.  ('21 ' 

4m\ 


riNOLC-UTTIRANCE  ISSUE* 
identification  af  Syntactic  Units 

Problem 

<!>.. mental  building  block 
<2)...1erge  Chinese  restaurant 
<3)..meat  shop  owner 
(4)...reariess  Chinese  ssidiar 
(3). heavy  cigar  emeker 
(6)  . Indian  Ocean  cruise  tine 
<7)..qlant  shrlme  cocktails 

(Serstiman,  tPSS.pp.  152- 1 dl) 
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Dlsousslon  section 


to  the  noun  groups  above,  there 
ere  some  complications  ia 
•tu chine  oeua-oodUier*  to  nouns 
la  "heavy  cigar  smoker,’  -heavy' 
modifies  'cigar  emeker*  not  'cigar  ' 
la  'Indian  ocean  cruise  Una.* 
however.  ’Indian*  modifies 
•Ocean'  and  net  *0(010  cruise  Use.' 

The  following  principles  help 
the  parser  determine  the 
attachment  ef  modifiers  to  nouns: 

l)>mty  concepts  built  by 
latent  words  can  modify 
each  other:  “mental  block*  1 


Vortical  serol  bar 
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Each  of  the  exemplars  has  at  least  one  linguistic  and  one  cognitive-psychological  cross- 
reference.  These  cross-references  are  displayed  when  the  user  clicks  on  either  of  the  cross¬ 
index  arrows  (see  Figure  2.4). 


■  FIGURE  2.4 
Croae-Referenoee 


Croee-reforonoee 


Click  her*  to  caned  March 


Click  hare  for  HELP. 
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fj  exemplar  l.  A.  {•*) 

SINGLE-UTTERANCE  issues 

Identification  of  Syntactic  Unite 


(1).. mantel  building  Sleek 
<2)..  terge  Chineac  reateurant 
(3).. meat  ahop  awnar 
l<4)...faarlaaa  Chinese  aaldiar 
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la  the  noun  groups  a  bora,  there 
are  eome  com  plica  tioos  la 
attaching  Bous-soodifiera  to  noun* 
la  "heavy  cigar  am  otter.*  "hvovy" 
modifies  "cigar  smoker*  act  "cigar  ' 
la  'Indian  Ocean  cruiee  hue." 
houwver,  'Indian*  modifies 
■Ocean'  aad  not  "Ocean  crulae  Uae; 


I.A.I.  Moua/verh 
I.A.2.  Noun/adjectlve 
■— — ■  I.A.3.  Noun/partlclplal  adjective 

I.C.I.  Naan  phrase  stmetars 
Cognitive-psychological:  IA.  Processing  sgataa 
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•  Sourcebook  Classification  Scheme 


The  Sourcebook  classification  scheme  is  displayed  on  one  card  and  is  contained  in  a  scrolling 
field  (see  Figure  2.5). 


Click  hara  for  HELP. 


FIGURE  23 
Soureabook 
Classification  Mania 


Soureabook 
classification  entries. 
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E.  tiataphor  and  navel  langvega 
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•  Linguistic  Classification  Schama 

The  linguistic  classification  scheme  is  displayed  on  one  card  and  is  contained  in  a  scrolling 
field  (see  Figure  2.6). 


Cflcfc  here  to  too  other  part*  of  tho  linguistic  classification  sc  homo . 
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•  Cognitive-Psychological  Classification  Schama 

The  cognitive-psychological  classification  scheme  is  quite  lengthy  (11  pages).  One  card  was 
assigned  to  each  of  its  six  major  sections  (see  Figure  2.7  for  an  example  of  one  of  the 
sections). 


Click  hero  for  HELP 


Click  hero  to  see  other  sections  of  tho 
Cognitive-psychological  classification  scheme 

■  FIGURE  2.7  ' 

Cognitive-Psychological 
Classification  Schama 
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classification  entries _ 
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•  Complete  References 


The  complete  references  are  displayed  on  one  card  and  are  contained  in  one  scrolling  field 
(see  Figure  2.8). 


FIGURE  2J 
Complete  Refer* no— 


Complete  reference 
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CUck  hors  to  return  to  tha  exemplars. 


To  scroll  through  oomptete  reference* 


Sourcebook  Database  Browsing  and  Searching  Features 

The  components  of  the  Natural  Language  Sourcebook  were  integrated  into  the  HyperCard 
environment  with  the  following  design  enhancements  tailored  specifically  for  the  Sourcebook 
Database: 

•  Sequential  access  to  the  exemplars  In  the  database  in  the  order  they  are  presented  In 
the  Natural  Language  Sourcebook 

The  database  can  be  read  ifce  the  Natural  Language  Sourcebook.  The  user  can  click  on 
either  of  the  browsing  buttons  at  the  top  left  of  any  exemplar  card  next  to  the  button  labeled 
"SB  MENU”  (see  Figure  2.9).  The  user  will  go  to  the  previous  or  the  next  exemplar  based 
upon  which  button  he/she  clicked. 

•  DlrectaccesstoanyexemplarlnthedatabasebaseduponitsSourcebookclasslflcatlon 

schema 

The  user  can  directly  access  any  exemplar  by  clicking  on  the  button  labeled  ‘SB  MENU”  at 
the  top  left  of  any  exemplar  card  (see  Figure  2.9).  The  user  will  access  the  Sourcebook 
Classification  Menu  (see  Figure  2.5),  and  this  stepwise  search  will  conclude  withthe  selection 
of  the  desired  exemplar  identification  number  (see  Figure  2.10). 


.  Sequential  aocees  to  the  pravloua  exemplar  in  the  databaee 

Sequential  aeoeaa  to  the  next  exemplar  In  the  databaee 


Sequential  aeeeea  to  Sw 
prevloua  exemplar  while 
keying  on  a  eroea-referenoe 


Sequential  aeoeaa  to  the 
next  exemplar  while  keying 
on  a  eroee-refbrenoe 


■  FIGURE  2J 
Browabig  and 
Searching  Featuree 


Direct  aeoeaa  to  any  exemplar  In 
the  databaee  via  the  Sourcebook 
Claaalfi cation  Scheme  _ 


Direct  aeoeaa  to  any  exemplar  In 
the  databaee  via  the  linguletie  or 
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claaalfi  cation  acheme _ 
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bewamr,  'Indian'  modules 
■Ocean*  and  pet  "Ocean  cruise  Has.' 
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tne  parser  determine  too 
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I)  Only  ooocepta  built  bp 
adjacent  words  caa  modify 
each  ether:  "mortal  block'  is 


Direct  acceaa  to  the  complete 
references 


Direct  access  to  the  first  exemplar  In  the  database  containing  a  specific  linguistic 
cross-reference  or  cognitive-psychological  cross-reference 

The  user  can  access  the  first  exemplar  in  the  database  containing  a  specific  linguistic  cross- 
reference  or  cognitive-psychological  cross-reference  by  clicking  on  the  button  labeled 
‘‘CROSS-INDEX"  located  at  the  middle  of  the  top  of  any  typical  exemplar  (see  Figure  2.9). 
The  user  will  go  to  the  first  exemplar  in  the  database  containing  the  classification  entry  that 
he/she  clicks  on  while  looking  at  either  of  the  classification  schemes  (see  Figure  2.6  or  2.7). 


■  FIGURE  2.10 
Sourcabook 
Classification  Submsmi 
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classification  on  try _ 
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•  Sequential  access  to  exemplars  In  the  database  while  keying  on  a  specific  linguistic 
classification  cross-reference  or  a  cognitive-psychological  cross-reference 


The  user  can  key  through  the  database  on  a  specific  linguistic  cross-reference  or  cognitive- 
psychological  cross-reference  by  clicking  on  the  left  or  right  cross-index  arrow  next  to  the 
button  labeled  "CROSS-INDEX”  located  at  the  middle  of  the  top  of  any  typical  exemplar  (see 
Figure  2.9).  The  cross-references  will  be  displayed  (see  Figure  2.4).  The  user  can  dick  on 
any  displayed  cross-reference  to  go  to  the  previous  or  the  next  exemplar  (depending  on 
which  direction  arrow  was  dicked  initially). 


•  Direct  access  to  the  complete  reference  of  the  current  exemplar 

The  user  can  access  the  complete  reference  of  the  current  exemplar  he/she  is  looking  at  by 
clicking  on  the  author’s  name  at  the  bottom  left  comer  of  any  exemplar  card  (see  Figure  2.9). 
The  complete  reference  will  appear  on  the  screen  along  with  adjacent  references  (see 
Figure  2.8). 

•  Search  procedure  for  any  author  In  the  complete  references 

After  the  user  accesses  the  complete  references  he/she  can  access  any  author  in  the 
complete  references  by  dick  on  the  button  labeled  ”REF  at  the  bottom  left  of  the  complete 
references  card  (see  Figure  2.8). 

•  Direct  access  to  any  exemplar  citing  a  specific  author 

While  looking  at  the  complete  references,  the  user  can  diredly  access  any  exemplar  in  the 
database  that  cites  a  particular  reference  by  clicking  anywhere  in  that  reference  (see 
Figure  2.8).  A  list  of  exemplars  will  be  displayed,  any  one  of  which  may  be  accessed  by 
clicking  on  the  line  containing  the  desired  exemplar  identification  number  (see  Figure  2.1 1). 


■  FIGURE  2.11 
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On-Line  Assistance 

Two  types  of  on-line  assistance  are  available  to  the  user. 

•  Quick  Reference  Guide 

The  Quick  Reference  Guide  describes  in  detail  the  functions  of  each  of  the  buttons  that 
appear  at  the  top  of  every  exemplar  screen  (see  Figure  2.12). 


FIGURE  2.12 
Quick  Reference  Guide 
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•  Prompting  Mods 

The  prompting  mode  provides  explanation  of  any  button  clicked  by  the  user.  The  three  types 
of  prompting  messages  are:  1)  YES/NO,  2)  Classification,  and  3)  Cross-Reference.  An 
example  of  one  type  of  prompting  message  is  show  in  Figure  2.13. 


Button  for  browsing  to  the  left 


■  FIGURE  2.12 
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_ Sourcebook  Database  User’s  Manual _ _ 

The  Sourcebook  Database  User’s  Manual  provides  a  step-by-step  description  of  how  to 
access  the  information  in  the  database  version  of  the  Natural  Language  Sourcebook.  The  user’s 
manual  consists  of: 

•  Table  of  Contents 

•  Initial  Section 

The  initial  section  provides  information  about  the  hardware  required  to  use  the  database,  as 
well  as  advice  for  backing  up  the  database.  It  provides  the  description  of  the  the  Sourcebook 
Database  User’s  Manual  that  is  found  below  in  the  chapter  information  section. 

•  Four  Chapters 

°  Chapter  1 ,  Introduction  to  the  Sourcebook,"  provides  a  description  and  explanation 
of  the  Sourcebook. 

0  Chapter  2,  "Browsing  Through  the  Database,"  describes  how  to  begin  using  the 
database.  A  description  of  a  typical  exemplar  is  provided  with  explanations  of  the  types 
of  fields  (Problem,  Discussion,  Cross-references)  and  buttons  used  to  browse  through 
the  database  exemplars.  The  method  of  accessing  the  references  is  discussed,  and 
finally,  the  process  of  exiting  the  database  Is  described. 

°  Chapter  3,  "Searching  for  Exemplars  and  Cross-References,"  provides  information 
on  searching  through  the  exemplars  via  the  Sourcebook  classification  scheme,  linguistic 
and  cognitive-psychological  cross-references  and  the  complete  references. 

0  Chapter  4,  "On-Line  Assistance,”  provides  a  description  of  the  Quick  Reference  Guide 
and  explains  how  to  use  the  prompting  mode. 

•  Appendix 

The  appendix  provides  a  discussion  of  the  linguistic  and  cognitive-psychological  classification 
schemes. 

_ Summary _ 

This  report  describes  the  development  of  a  HyperCard  stack  version  of  the  data 
presented  in  the  Natural  Language  Sourcebook.  The  HyperCard  stack  versionof  the  Sourcebook 
capitalizes  on  the  modular  structure  of  the  Natural  Language  Sourcebook  exemplars.  HyperCard 
organizational  features  are  appropriate  to  a  functional  presentation  of  the  Sourcebook  structure. 
For  example,  the  finking  of  exemplars  by  various  classification  schemes  is  concretely  and  visually 
realized  by  links  between  specific  cards.  The  hierarchical  nature  of  HyperCard  provides  an 
efficient  means  of  organizing  the  structure  of  the  exemplars. 

The  HyperCard  Sourcebook  database  will  be  an  asset  to  artificial  intelligence  researchers, 
cogntive  scientists,  and  computational  linguists  who  wish  to  access  the  information  contained  in 
the  Natural  Language  Sourcebook. 
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